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REMARKS 

Present Status of the Application 

The Office Action rejected claims 1-6. Specifically, the Office Action rejected claims 1-6 
under 35 U.S.C, 102(b) as being anticipated by Bergstedt (U. S. Patent 6,094,302). 
Alternatively, the Office Action also rejected claims 2 and 3 under 35 U.S.C. 103(a) as being 
unpatentable over Bergstedt. Applicants have amended independent claim 1 and cancelled 
claims 2-3. After entry of the foregoing amendments, claims 1 and 4-6 remain pending in the 
present application, and reconsideration of those claims is respectfully requested. 

Discussion of Office Action 

The Office Action rejected claims 1-6 under 35 U.S.C. 102(b) as being anticipated by 
Bergstedt. The Office Action also rejected claims 2 and 3 under 35 U.S.C. 103(a) as being 
unpatentable over Bergstedt. Applicants have amended independent claim 1 and respectfully 
traverse the rejections for at least the reasons set forth below. 

With respect to amended independent claim 1, the first mirror and the third mirror are 

symmetric to the virtual reference surface, and their included angles are substantially equal to 

60°. The symmetric included angle at 6(f is essential to achieve the de-rotation function. 

Page 4 of 6 

>AGE 5M4 * RCVD AT 12/12/2003 5:56:31 PM [Eastern Standard Time] • SVR:USPTO-EFXRF-1/0 ■ DN1S:8729306 ' CSID:1949B600809" DURATION (mm-ss): 04-54— 



12-12-03; 3:49PM; 



; 1 9496600809 



# 6/ 14 



Application No.: 10/047,805 Docket No.: JCLA8069 

Applicants submit the published paper in "2003 IEEE Camahan Conference on Security 
Technology, p. 183-189", which is published by one of the inventors. In FIG. 13 of the 
published paper as discussed in Section 4.3, the three normal vectors N41, N42, and N43 are 
obtained. Then the whole reflection transfer matrix M4 can be diagonalized (page 9). 

Therefore, the included angle by 60° is essential in de-rotation mechanism with the 
non-obviously unexpected result. 

In re Bergstedt, the mirrors E, D, F are used in a camera. Basically, Bergstedt does not 
specifically consider the de-rotation function. More specifically, Bergstedt fails to disclose the 
included angle by 60°. 

For at least the foregoing reasons, Applicants respectfully submit that independent claim 1 
patently defines over the prior art, and should be allowed. For at least the same reasons, 
dependent claims 4-6 patently define over the prior art as well. 
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CONCLUSIONS 

For at least the foregoing reasons, it is believed that all the pending claims 1 and 4-6 of the 
invention patently .define over the prior art and are in proper condition for allowance. If the 
Examiner believes that a telephone conference would expedite the examination of the 
above-identified patent application, the Examiner is invited to call the undersigned. 



Respectfully submitted, 
J.C. PATENTS 



Date: 



Jiawei Huang (J 
4 Venture, Suite 250 Registration No. 43,330 

Irvine, CA 92618 
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Abstract 



"Panoramic stabilization " and "common optical 
path" as designed in this paper are two significant 
issues regarding the technology of periscope 
detection. The: idea of "panoramic stabilization " is to 
construct a pseudo level coordinate while in 360 " 
searching. Sighting vector to the target expressed by 
.spherical coordinate should be based on this 
panoramic stabilized level The design of "common 
optical path " entirely employs a set of reflection 
mirrors with folded optical path for various light 
wave bands to shorten the size of the periscope. 
Devices associated with these features are developed 
and wrapped up in terms of an analysis of conceptual 
configuration. {Topic No. 2) 

Keyword: Periscope, Panorama, Stabilization, 
Common optical path 

1, Introduction 

. The paper relates to a periscope, and more 
particularly to a periscope having IR (inferred) rays, a 
laser beam and visible light going through the same 
optical path, being split by beam splitters and then 
being received by a CCD day sight camera, an IR 
night vision camera and a laser range finder (LRF). 

Normally, military tanks are equipped with a 
periscope to gather useful information without risking 
exposure to personnel inside the vehicle. The 
periscope includes a CCD camera, an IR sight and a 
laser range finder, all of which have independent 
elemems with respect to each other, and each has its 
own optical path. Therefore, the periscope is very 
large and expensive. Furthermore, due to the line of 
sight of each of the aforementioned elements, 
mounted on the same turret, being different from 
each other, the problem of over weighting, sighting 
parallax error, over sizing, and lag response caused 
by the turret might be crucial in modem warfare. 

To overcome the shortcomings, this paper tends 
to provide an improved periscope to mitigate and 
obviate the aforementioned problems by integrating 
the different optical paths of the IR sight, the laser 
range finder and the CCP camera together so as to 
reduce the overall elements used in the periscope and 
the cost as well. 

As shown in Fig.l, the improved periscope [1] is 
composed of two portions, me upper portion and the 
lower portion physically. The upper portion, a portion 
of so-called common optical path, has a head mirror 



assembly, a parabolic reflection mirror, an aspherical 
mirror and a de-rotation mirror module in sequence to 
shorten the common optical path in the periscope. 
The head mirror assembly, usually tilting at 4S °, has 
two gimbals on which a head mirror, two PM motors 
[2], two gyroscopes and two resolvers are mounted. 
The parabolic reflection mirror reflects the light 
upward lor folding the optical path. The aspherical 
mirror, mounted on a mechanism for controlling 
focusing and magnification [3], reflects the 
light downward. The de-rotation mirror module [4] 
de-rotates the image to compensate for the traverse 
azimuth (AZ) rotation between the periscope head 
and its body. 

The lower portion is composed of beam splitters, 
lenses, reflecting mirrors for splitting the IR ray to IR 
camera and the visible light to CCD camera 
individually. Furthermore, employing a two-way 
polarized beam splitter allows the laser beam to be 
transmitted and received by the laser range finder. In 
this way, three different light beams are able to share 
a common optical path in the upper portion and to be 
split via beam splitters in the lower portion. Size and 
cost of the elements in the periscope are thus reduced. 




Fig. 1 A configuration of the periscope 

As to the control function, "panoramic 
searching", "attitude stabilization" and "de-rotation" 
are three key issues to be improved and illustrated in 
the following. The purpose of panoramic searching is 
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to acquire a panoramic view with constant AZ rate 
and fix elevation (EL) angle relative to the level 
regardless of platform tilting or yawing motion. *Qie 
function of stabilization for stabilizing the line of 
sight (LOS) is needed whenever there exists rate of 
platform tilting and yawing motion, or even the rate 
of target motion, and rate of level searching 
command 

2. Panoramic searching [5] 

Since the head minor of traditional periscope mounted 
on the turret usually has only an EL gimbal, the target 
acquisition is based on the AZ drive of gua turret The 
periscope itself Is unable to search for panorama 
independently and thus fails to record the panorama image 

tt r . *>. / a\jTS r>~- 

pfoucii li iui duiuniaii^ rivicv uniting ^rtr i ). i-ui 

those periscopes to date, equipped with dual gimbal drive 
(AZ & EL), an approach to control the gimbal angle is 
developed as follows to have the light reflected from tho 
head mirror align with the internal longitudinal optical path. 
Panoramic searching is to generate a 360 ° panorama 
via level searching by controlling the dual head 
mirror gimbals in cases of platform tilting and 
yawing. Note that the target search sighting vector, 
i. c. incident light vector to the head mirror, is 
defined in terms of level coordinate. The inputs while 
searching are 1) platform attitude angles heading, pitch 
and roll, 2) fix angle "E"w. r. t the level and 3) angle M A"w. 
r. t the level The outputs are 1) head mirror AZ command 2) 
head mirror EL command 

2.1 Geographic level coordinate 

In the following approach, local tevel coordinate 
<E L , iN L , U L > with "E L " denoting the east, "N L M the 
north and "U L " the vertical up is complied with the 
right hand rule as shown in Fig. 2. Heading angle 
"H" is along the vertical relative to the north. Pitch 
angle "P" is along the starboard axis. Roll angle "R" 
is along the longitudinal axis. 

2.2 Gimbal totem and notation 

Hie mounting sequence of gimbal totem in the 
drive mechanism of gyrocompasses or the head 
mirror of periscope is important whenever coordinate 
transformation is applied Platform attitude U H", "P" 
and "R" relative to the geographic level coordinate is 
usually seosed by gyrocompasses or inertial 
navigators in which the gimbal totem is a type of 
"H over P, P over R". As to the head mirror of 
periscope, the gimbal totem is a type of f the "EL 
over AZ". Furthermore, the searching vector <AJ£> 
in spherical coordinate relative to the geographic 
level is a pseudo gimbal totem of "E over A" type. 
The spatial /level searching format for constant 
speed search on level or fix EL search above level 
is given respectively by: 



A=Const, E=0 
A=Const. E>D 



(I) 
(2) 



l 












— 0 








Ei 1 





Fig.2 Local level coordinate 



2.3 Coordinate transformation 

Assume that the instant search angle is <A,E> Si 
the platform attitude angle is <H> P, R> a the head 
mirror gimbal angle is <AZ, EL> M . where subscript 
"S" denotes the search, "G" the gyrocompass and 
"M" the head mirror, then the coordinate 
transformation is given as follows. As shown in Fig. 
3, three unit vectors along the level coordinate <E,N, 
U> u are transformed to the head mirror gimbal 
coordinate < X 3 , Y 3 , Z 3 > via the coordinate 



transformation sequence [H)-*[P]-*[R; 

~* CosH SinH 0" 

[BJ- 



IP] = 



[R] = 



-SinH Costf 0 
0 0 1 

10 0 
0 CosP SinP 
0 -SinP CosP 
CosR 0 SinR' 

0 1 o 
-SinR 0 CosR 
The three projected unit vectors e 3>x > O 3o , and 

6 3j2 in<X 3 ,Y 3 , Z 3 > coordinate after [H]->[P] 
-►[R] transformation are obtained as follows: 



defined by; 
(3) 



(4) 



(5) 



(3>e, 



-[R)[P][H] 



= [R][P](H3 



I 
0 
0_ 
0' 

I 



(6) 



(7) 
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"0" 


e« - 




= [R][P3[H] 


0 








1 



(8) 



(9) 



"1 0 0" 

0 1 0 

0 0 1_ 
*yr «„] = [RKP][« (10) 

Z, 




x,.x 2 

Fig. 3 [R][F](H] coordinate transforrnation 

2A Angular command of bead gimbal 

Assuming at the iVth time increment, the level 
search angle is A« t then tbc search unit vector 
on the level is 

° 0I) 

As shown in Fig.4, the projection X aAN ,Ya AN 
and Z nAN on the <X 3 ,Y 3 ,Z 3 > respectively from 
the search unit vector e AN is calculated as follows: 




Fig.4 Projection from search level to head gimbal 



'LAN 



(13) 

04) 

05) 
(16) 



(17) 



Where [e JX e^ r e iZ ] is a 3x 3 matrix. 



Normalize 

*3AN + y 3 AN + 2 3 AN = ^ 

y^y™* /* 

The gimbal angular commands are 

>4Z AN = tan" 1 (J 3A N / x ian) 
2?Z. N = tan- 1 I Vjj^+yi^ )(") 

After the drive control of gimbal -42^ , the three 

vectors Z y * <x 1AN • y 3iW >and £ AN remain on 
the same plane. Moreover, after the drive control of • 
gimbal EL AN , the head mirror sighting vector and 

£ AN are parallel and on the same plane as required 

3. Attitude stabilization [6] 

A control method for attitude stabilization applied to 
the periscope, said method is a combination application of a 
coordinate transformation, a gyroscope and an automatic 
video processing to obtain panoramic stabilization of 
periscope in the operation modes of "searching**, "tracking" 
and "firing", 

3.1 Searching stabilization 

The operation of searching mode is based on a 
level spherical coordinate system so that head mirror 
sighting vector is scanned at constant velocity 
orthogonal to the level. Without stabilization, 
sighting vector of head mirror will be affected by 
platform attitude angle rate, i.e. heading rate, pitching 
rate and yawing rate. Therefore, attitude stabilization 
plays a significant role while searching since head 
mirror sighting vector should be stabilized on the 
level or at a fixed EL angle above the level so as to 
keep the reflected light remain on the optical path 
inside ihe periscope as if it were stationary regardless 
of platform attitude change rate. 

The design of attitude stabilization is to scheme the 
control of the shafts of head mirror motors rather than that 
of head mirror in casc3 of platform tilting or yawing while 
searching. Note that the shaft of head mirror EL motor is 
linked to that of head mirror by a mechanism as shown in 
Fig. 5. With reference to Fig. 5, it illustrates the 
stabilization theory of head mirror and elevation motor 
shaft while the platform being tilted. For stationary surface 
target, LOS (line of sight) is certainly on the level arid the 
platform plane or the platform normal line vertical is 
assumed to pitch up an angle 0 to LOS* in CCW direction 
along the EL axis. Jn the meanwhile, head mirror M 
accordingly also pitches up an angle 0 to M 1 in CCW 
direction. It will result in that the reflected light of head 
mirror pitches up 2 0 from the local vertical or 0 from 
the platform normal line, In order to have the reflected light 
of head mirror remain on the platform normal line, M' 
should be rotated back an angle 0/2 m CW direction to 
M" by controlling the angle of head mirror EL motor as 
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indicated by the new mirror normal line N 1 . In other words, 
the amplitude of counter rotation of bead mirror is just half 
of the platform pitch angle. Furthermore, EL motoT is to 
rotate an angle 6 in CW direction wherein the gear ratio of 
moioT axis to head mirror is 1:2 and the angle reading $ 
from the resolver mounted on EL motor shaft is thus the 
so-called stabilization angle. 




Fig.5 EL stabilization 

As aforementioned, the generalized attitude 
stabilization is just regarding the angle compensation 
associated with the coordinate transformation. But for 
rugged stabilization, compensation of angular rate or 
even angular acceleration is also required. In Fig.6, 
EL stabilization loop is operated by employing a rate 
integrating gyroscope of closed loop to sense the EL 
inertial rate of the shaft of head mirror EL motor so 
as to compensate for the rate of platform tilting 
composed of pitch and roll. As to the AZ stabilization* 
it is straight to construct the control loop via the 
above concept of the EL stabilization. 





-i — — i 
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! !___ &^ZZ 

1 

_j h 
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Fig.6 EL stabilization loop 

3.2 tracking stabilization 

Fig. 7 illustrates the tracking stabilization of 
head mirror and its EL drive motor. Assuming chat 
the platform is stationary while the target is moving 
up, then LOS pitches up an angle, saidcD, in CCW 
direction to the LOS' in the sense. Without control of 
head mirror, the light reflected from head mirror 
rotates <D in CW direction from the platform normal 
line or the vertical. In order to have the light reflected 
from head mirror still 6tay on the platform normal 
line, the head mirror has to rotate <X>/2 in CCW with 
normal line N rotating to N'. In other words, EL 
motor has to rotate (pin CCW direction through the 
1:2 mechanism, Obviously, the motor angle to be 



controlled is equivalent to the LOS angle O and the 
reading of G> is picked up from the EL Tesolvcr. 

In cases of presenting both platform tilting B and 
target tracking O, the combined control angle of the 
EL motor from attitude stabilization and tracking 
stabilization will be <D — 6 . This result points out 
that the amplitude of compensation control is the 
same as that of the sensing if employing the 1:2 
mechanism. In this way, the so-called "half angle 
reflection** as above is no more a trouble problem to 
the control design. 




Fig.7 EL tracking loop 

Fig. B(a) shows a block diagram of tracking 
stabilization, and Fig. 8(b) a complementary 
weighting rate assignment, ic. weighting factors of 
stabilization Ws and tracking W T w. r. t tracking 

error. Note that in Eq. (19) and (20). 0c- f and 
are two states to be controlled. 

0'\.\~ ^G-P~^ 

(19) 

#T-t = #C4> + &VA = 0&I 

(20) 
Where 

tracking error e 5=5 0 T ^ 

rate of tracking error £ = 6 T . 0 

(T : Target, 1 : Inertia, G : Gimbal, P : Platform) 




00 

Fig.8. A loop of tracking stabilization 
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by: 



la Fig. 8, W 7 and W s are complementary given 



(21) 



W T +W S =1 
The other notations are defined as follows: 

AVT: Automatic video tracking, RIG: Rate 
integration gyroscope, COMP: Compensator, GMB: 
Gimbal. DERO; De-rotation, V/s: Weighting factor of 
stabilization, W t : Weighting factor of tracking, 31: 
Gyro stabilization, 32: Video tracking, 33: Gimbal 
servo, 34: De-rotation (only for AZ gimbal) 

3.3 Firing stabilization 

In Fig. 9, a sequence of LOS, i.e. LOS I, LOS 2 
and LOS 3 to the right, is shown to illustrate the 
firing stabilization. The traditional tiring procedure 
has two phases, i.e. lay-on-target and rclay-on-target. 
Ai the insi&xu of LOS 1 duitiig the phase of lay-Oii- 
target, calculation of leading angle 6 h to the right is 
completed and the reticle is pulled off 6 L to the left 
by AVT. During the short duration that the gun 
rotates 6 L to the right w. r, t. LOS 2 , the target 
moves A 0from LOS 1 to LOS 2 in the sense of 
traditional relay-on-target In other words, the gun 
totally moves 9 L + A 9 to LOS 3 or LOF, the line of 
lire. In the mean time, the reticle also moves 9 L 4- 
A 0to LOS 2. In this way, the traditional manual 
modes of lay-on-target and relay-on-target are 
automatically accomplished by gyro stabilization 
firing computer and image processing AVT. 




Fig.9 LOS and firing stabilization 
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Fig. 10 A loop of firing stabilization 

Fig, 10 shows the loop of firing stabilization still 

using the complementary approach, wherein 

including: 



71: Video processing, 72: Gimbal stabilization, 73: Gun 
control. AVT: Automatic video tracking, RIG; Rate 
integrating gyroscope, GMB: Gimbal, W*: Relay weighting 
factor, \V U : Lay weighting factor, GUN/TUR: Gun/Turret 
Note that 

W a +W t =l (22) 

4. De-rotation [7] 

In order to keep the vertical polarity of acquired 
image in the periscope from disturbing of the head 
mirror AZ rotation, a de-rotation mechanism has to 
be designed so as to compensate for the traverse 
rotation caused by the head minor AZ rotation. 

4.1 Reflection matrix 

Fig. 11 shows an input object with <P> R, U> 
vector, where U P" is the incident light vector to the 
mirror and n R" to the object right, %i V n to the 
object upper as viewed from the normal vector N of 

the mirror plane M p . 




Fig. 11 Mirror reflection 

Obviously 

RIP, RLU, U±P. P = UxR,R \\ M p (21) 

Assuming that/t 1 is the right vector of the reflected 

image and E/ 1 the upper one. There exists a 
reflection matrix U M 99 to transfer from the incident 
light vector t$ P " to the reflected light "P 1 "and so 
on such that: 



P X =MP 
R l - MR 
U X =MU 
Assuming 



iV = 



Then we have 



X" 




>/ 




>'," 


tt, 


• p = 




■ P' = 


P\ 


X. 




P,_ 




P\ 



(24) 
(25) 
(26) 



(27) 
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M = 



Q-2N, 1 )-2N x N l ,-2N A N l 
-2N x N y (l-2N y *)-2N,N : 



(28) 



4.2 Effect of head mirror AZ rotation 

Assuming the head mirror AZ girobal is 
originally fixed with mirror normal N, tilted to 45° 
below the level as shown in Fig. 12. Then we have 



1 

71 



(29) 



Note that the subscript **i " means the input. "<T the 
output and 



(31) 




Fig. 12 Head mirror reflection 
Whenever head mirror AZ rotates 9 angle, (he new 
normal vector jV 19 is 
M ]0 = R 0 N t ( J?0 is rotation matrix) 



cos 0 -sm# 0 
sin0 cos0 0 
0 0 1 



1 



42 



-1 

0 

-1 



) 



1 

: 72 



-COS 9 

-sin 0 
-1 



(32) 
(33) 

(34) 



Since rotation matrix is orthogonal, we have 
[r w W*]-XoV " 2^ r )J?/^] (35) 



i.e. M, $ =R $ M x Rj 



(36) 
(37) 



costf -sintf 0 
sin0 cos£ 0 
0 0 



oTo 0 -iT 
0 0 I 0 fi- 
ll- ] 0 oJ[ 



cu$0 sine> 0 
0 0 I 



(3S) 



sin 2 *? -sin0cos# -cos# 
-sin0cos0 cos 2 0 -sin# (3°) 
-cos£ -sin0 0 
The right column indicates that the vertical polarity is 
tilted to an angle 9 in the fourth quadrant of <X, ( 
Y,> plane. After next two reflections via parabolic 
minor and aspherical mirror, the vertical polarity is 
rotated to the first quadrant of <X 3 ,Y 3 > plane. 

43 De-rotation transfer matrix 

AS SjiO'WTj J tu Fig. 1 3, the dc-rotatioij Tiiechaiiisru 
is composed of three reflection mirrors with normal 
lines mutually separated by 1 20° and expressed by: 

"-V3/2] [1] 

0 „V 42 = 0 >A^ 43 = 
1/2 0 



2 

2 j 



(40) 




Fig. 13 De-rotation mirror module 
Each reflection transfer matrix M 4f (i = 1,2,3) is 
expressed by: 



A/, 



Sub. Eq.(40) into Eq.(41) > (42)and (43) 



2 2 
0 I 0 

4° j 



-10 0 
0 ] 0 
0 0 I 



A/ 0 = 



2 

3s 



The whole reflection transfer matrix M \ is 
f-1 0 0" 



1 

0 



(41) 
(42) 
(43) 



0 -£1 

2 

1 0 

• \ 

(44) 



(45) 



Eq.(45) points out that the vertical polarity is now 
rotated to the second quadrant as shown in Fig. 14 
without de-rotation compensation. Suppose that de- 
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rotation module is rotated <X> along the Z 4 axis, 
the vertical polarity will move to the negative X 4 .The 
de-rotation effect is thus eliminated. Then we have 

M\*=R*M A Rj (46) 

Where 



cos<* sin^ 0"| 
-sin# cos^ 0 
0 0 1 







" cos^ 




0 


s 






0 




0 


0 



T" 1 

> 0 

1° 



-1 0 

\ 

0 



0 1 sin^ 

>1 o 



(47) 



cos<J 0 msin0 
0 ll 0 J 



reflection mirror. We obtain Where u rrT is the 
magnification of .parabolie 

(49) 

Eq. (49) indicates that the de-rotation control angle is 
counter half of the head mirror AZ rotation angle. 




Fig. 14 Input and output of de-rotation module 
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5. Conclusion 

A configuration design of the panoramic 
stabilized periscope with common optical path is 
developed in this paper. Three significant issues, i.e. 
£l panoramic searching", "attitude stabilization" and 
"image de-rotation" are analyzed respectively. Based 
on the approaches given above, following research 
associated with "de-rotation simulation", "panel 
display for modes of searching and stabilization" and 
"implementation hardware" are further accomplished 
without illustrated due to page limitation. 
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